Top quark spin and Htb interaction in charged Higgs and top quark associated 

production at LHC 
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We study the charged Higgs production at LHC via its associated production with top quark. 
The kinematic cuts are optimized to suppress the background processes so that the reconstruction 
of the charged Higgs and top quark is possible. The angular distributions with respect to top quark 
spin are explored to study the Htb interaction at LHC. 
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Q ; I. INTRODUCTION 

, The Standard Model (SM) of particle physics, with great success, is based on two cornerstone: gauge symmetry 
and electroweak spontaneous symmetry breaking mechanism (EWSB). The gauge group SU(3)c X SU(2) L x U{l)y 
of the SM has been confirmed by the discovery of W/Z bosons and lots of precision measurements. As the other 
cornerstone, the mechanism of EWSB is implemented by introducing only one complex Higgs doublet $ in the SM and 
then trigging the electroweak symmetry breaking after the neutral component of $ developing a vacuum expectation. 
In the meanwhile, the masses of weak gauge bosons and fermions are generated. In the SM, there is only one physical 
neutral Higgs boson H after EWSB. The discovery of the Higgs boson will help to unveil the mysteries of EWSB and 
mass generation of SM particles. Recently, one Higgs-like particle around 126 GeV has been discovered at LHC by 
ATLAS and CMS collaborations 0, It is important to further confirm the identity of this particle. In SM, only 
one complex scalar doublet is introduced based on the "minimal principle". It is natural to consider more complex 
scalar sector, for example, the two Higgs doublet structure. Especially, there are many motivations to study the two 
Higgs doublet model (2HDM). Such as, in the supersymmetric models, a single Higgs doublet is unable to give mass 
qq . simultaneously to the charge 2/3 and charge -1/3 quarks and the anomaly cancelation also require additional Higgs 
■ doublet. Another motivation for 2HDM is that it could generate a baryon asymmetry of the universe of sufficient size. 
—J \ Interestingly, ATLAS and CMS announced that there is an enhancement in the di-photon channel of Higgs decay 
^—" l ■ h — > 77 [J [2j • This enhancement can be explained by charged Higgs from 2HDM[3]. 

I There are many scenarios in 2HDM structure [3,111 • Without imposing discrete symmetries, the 2HDM suffers 
t-H ■ serious flavour changing neutral currents (FCNC) at tree-level. For the suppression of leading order FCNC as well as 
CP violation in the Higgs sector, we consider CP-conserving 2HDMs with extra discrete symmetry. Popular Type I 
and II 2HDM belong to this kind. As one of the minimal extensions of the SM, 2HDM [1, has five physical Higgs 
scalars after the spontaneous symmetry breaking, i.e., two neutral CP-even bosons and Hq, one neutral CP-odd 
boson A, and two charged bosons H^. In diverse models, different scalar multiplets and singlets could generate neutral 
scalars and there exists mixing between neutral scalars which make it difficult to unentangle the Higgs properties and 
confirm the existence of extended Higgs sector. However, the discovery of the charged Higgs boson could provide an 
unambiguous signature of the extended Higgs sector and help to further distinguish models. 

Motivated by above reasons, the charged Higgs has been searched for in many years at colliders. One model- 
independent direct limit from the LEP experiments which gives M > 78.6 GeV at 95% C.L. where M represents the 
mass of charged Higgs by exclusive decay channels of H + — » cs and H + — > t + v[&\. At hadron colliders, the search 
approaches for the charged Higgs are different in low mass range M < m t and in large mass range M > m t . In the low 
mass range M < m t — nib, the search for the signal mainly focus on the top quark decay t — > H + b followed by decay 
mode H + — > fv. On the other hand, for large mass range M > m t + rrib, the signal is from the dominant production 
process, the gb fusion process gb —> tH~, followed by dominant decay modes H~ —> tb and H~ —} tv. The Tevatron 
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has put a constraint to 2HDM on the small tan j3 and large tan /3 regions for a charged Higgs boson with mass up to 
~ 160 GeV 0]. In addition, the indirect constraints can be extracted from B-meson decays since the charged Higgs 
contributes to the FCNC at one loop level. In Type II 2HDM, a limit on the charged Higgs mass M > 316 GeV 
at 95% C.L. is obtained dominantly from b — > S7 branching ratio measurement irrespective of the value of tan/3 Q. 
However, in Type III or general 2HDM the phases of the Yukawa couplings are free parameters so that M can be 
as low as 100 GeVji]. More detailed discussions on phenomenological constraints on charged Higgs, we refer to Ref. 

Along with the experimental search for the charged Higgs boson, extensive phenomenological studies on charged 
Higgs b oson production have been carried out [1JHL8I ]. Especially, the gb fusion process gb — s- tH~ for M > m t + mb 
|13H19I | has drawn more attentions due to the large couplings of Htb interaction. 

In this work, we revisit this process at the LHC and take a method similar to Ref. [2(| to distinguish the signal 
from backgrounds. As demonstrated in Ref. [20| . the angular distribution related to top quark spin is efficient to 
suppress background and disentangle the chiral coupling of the W boson to SM fermions. Here, we choose the angular 
distributions of the top quark and the lepton resulting from top and charged Higgs decay to disentangle Htb couplings 
at LHC. 

This paper is organized as follows. In Section [II], the corresponding theoretical framework is briefly introduced. 
Section IIII1 is devoted to the numerical analysis of top quark and charged Higgs associated production. Specifically, 
the correlated angular distributions are investigated to identify the interaction of top-bottom quark and charged 
Higgs. Finally, a short summary is given. 



II. THEORETICAL FRAMEWORK 



A. Lagrangian related to the interaction of Higgs and quarks 

We start with a brief introduction to the two-Higgs-Doublet Model (2HDM) which is one of the minimal extensions 
of SM. Different from SM, 2HDM involves two complex SU(2) l doublet scalar fields. 



(H? + iA*)/V2 

where i — 1,2. Imposing CP invariance and U(1)em g a uge symmetry, the minimization of potential gives 

<*>-;*(:)■ 

with Vi (i = 1,2) are non-zero vacuum expectation value (VEV). One important parameter in 2HDMs tan/3 = i^/fi 
is defined accordingly, which determines the interactions of the various Higgs fields with the vector bosons and with 
the fermions, thus has substantial meaning in discussing phenomenology. The most severe constraints on tan /3 and 
M come from flavour ph ysic s including B and D mesons, AM^, b —> sj and Z —> bb$, [2l|. Large tan/3 is favored 
by B meson rare decays |22h24| . Specifically, for the Type II model, the upper bound on tan/3 from D s — > tv t is 
tan /3 < 50 with charged Higgs mass M = 600 GeV [|J . 

In this work we aim to study the charged Higgs phenomenology with large tan j3 and choose the Type II Yukawa 
couplings as the working model 

— C = — cot/3 ul{H + iA)uR — cot /3 ur(H — iA)ul 

v v 

M d - M d - 
+ tan d L (H - iA)d R + tan j3 d R (H + iA)d L 

v v 

M u M d 

_V2cot^ vl d d L B'u R - V2tan/3 V^ d d R B~ ul 

v v 

M u M d 
-V2cot/3 V ud u R H + d L - v^tan/3 V ud u L B + d R . (2) 

V V 



The VEV of SM Higgs is related as v = \Jv\ -\-v\. tbH vertex given in Ref.Q can be written as 

9b- tb = TTtI [m t cot/3(l +75) + mf,tan/3(l - 75)] = g a + g b j 5 (3) 

2v2mw 

with g a b = (tan/3mf, ± cot/3mt)/(2v / 2mw)- In the specific discussions below in Sec. Ill, we will consider various 
combinations of g a and gb accordingly. 



FIG. 1: Feynman diagrams for gb — > tH — > ttb process. 



B. Charged Higgs production associated with single top quark at hadron colliders 

We begin to consider the following processes(Fig. [TJ 

g(pi) + b(p 2 ) -> t(p 3 , s t ) + H-{p 4 ) -> t(p a , s t ) + b(p 5 ) + t{p 6 , s f ), (4) 

where pi denotes the 4- momentum of the corresponding particle. St(sj) is the (anti-)top quark spin in 4-dimension 
and s 2 — s 2 = -1, p 3 ■ s t — pe ■ a* = °- 

Under the narrow width approximation of the charged Higgs, i.e., the charged Higgs produced on-shell, 

& (pi-m^+w -> i4 ^ - M2) < (5) 

where T and M respectively denote the decay width and mass of the charged Higgs boson, the matrix element squared 
including top quark spin information for the process (|4]) can be written as follows 



where 



\M(s t ,s { )\ 2 = m \M gb ^ m -(s t )\ 2 \M H -^ b t(st)\ 2 5(pl-M 2 ), (6) 

2 

\M gb ^ tH - (s t )\ 2 = ^-{A + fix (pi ■ s t ) + B 2 (p 2 ■ st)}, (7) 



\M H -^bi(st)\ 2 = (gl + gl)(M 2 -m\- m 2 ) - 2(g 2 a - g 2 b )m b m t - 4g a gbm t (p 5 • s f ). (8) 
The formula for A, B\ and B 2 are listed in the following 



with 



A = (g 2 a + g 2 h ) A x + m b m t {g 2 - g 2 a ) A 2 , (9) 
s(Pi ■ P3) ~ ^b(4ffli ■ p 3 + 3p 2 ■ p 3 ) s(pi -p 3 ) + m 2 (s - 2p 2 ■ p 3 ) 



(s-mg) 2 4(pi-p 3 )' 
m 2 (s - 2mg) - 2(pi 'p 3 K + 2 ( g ~ 2 P2 vPgXpi -ff3 +P2 -^3) 
2(pi -P3)(s - ml) 



(10) 



and 



_ (5 + 2m 2 ) m 2 -p!-p 3 2p 1 -p 3 + 4p 2 -p 3 - s 
2 (s-m 2 ) 2 + 2( Pl -p 3 y 2{ Pl -p 3 ){s-ml) 1 J 

Si = 2g a g b m t [-p. 2T2 + "77 72" + 7 7F 2T ' ( 12 ) 

{s-m%Y 4(pi-p 3 y Pi-p 3 [pi -P3){s - mgj 

o o r 3m b , m ? -Pi - Pi . s- Pl -p 3 -2p 2 -p 3 

B 2 = 2g a g b mt[jz 2x2 + ^77 72~ + ~ 7 7F 2T~ ■ ( 13 

(s-m£) 2 2(pi-p 3 ) 2 (Pi-p3)(s-mg) 

(14) 

Obviously, the top quark spin effects which are related to the product (g a g b ) disappear for a pure scalar or pseudo- 
scalar charged Higgs boson. The matrix element squared for the process gb —> tH + —> tib can be obtained from the 
above equations by using CP-invariance. The spin density matrix for the subsequent polarized top quark decay 
be found in Ref. 25 1. 
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FIG. 2: The total cross section as a function of M for pp — > tH process at LHC for (a) 8 TeV and (b) 14 TeV. 



III. NUMERICAL RESULTS AND DISCUSSION 



For the processes pp — > tH , the total cross section can be expressed as 

a = J fg(xi)fb(x2)<r g b-+M- {xix 2 s)dx 1 dx 2 , (15) 

where f g (xi)(fb(x2)) is the parton distribution function(PDF) of gluon(quark), y/s is the center of mass energy (cm.) 
of parton-parton collision, and a is the partonic level cross section for gb — > tH~ process. In our numerical calculations 
we set V th = 1, M w = 80.399 GeV, m b = 4.70 GeV and m t = 173.1 GeV. For PDF, we use CTEQ6Ll||. In Fig. 
the total cross sections for the process pp — > tH~ are shown as a function of charged Higgs mass for tan/? = 10, 30, 
and 50 in 2HDM at the LHC with 8 TeV and 14 TeV. Obviously the tH~ production rate at 14 TeV is much higher 
than that at 8 TeV. 

In the following, we respectively investigate the processes 

pp -> tH~ ttb ->■ bl + + bbjj + fi T , (16) 



pp tH~ ttb ->■ bjj + bbr + $ T . (17) 

In process ()16|) . the top quark produced associated with H~ decays semi-leptonically, and the anti-top quark from 
charged Higgs decays hadronically, i.e., t — > bl + vi and t — > bjj. While in process (IT7|) . t — > bjj and i — > bl~i>i. The 
charged lepton can be used to trigger the event. The dominant background for the above processes is pp — > ttj events. 

To be more realistic, the simulation at the detector is performed by smearing the leptons and jets energies according 
to the assumption of the Gaussian resolution parameterization 

■V = 7S sb - (18) 

where 5(E) / E is the energy resolution, a is a sampling term, b is a constant term, and © denotes a sum in quadrature. 
We take a = 5%, b = 0.55% for leptons and a — 100%, b — 5% for jets respectively |27j. 

For our signal process, one top quark which decays hadronically can be reconstructed from the three jets by 
demanding \Mjjj — m t \ < 30GeV, while to reconstruct another top that is leptonically decay, the 4- momentum of the 
neutrino should be known. But the neutrino is an unobservable particle, so we have to utilize kinematical constraints 
to reconstruct its 4-momentum. Its transverse momentum can be obtained by momentum conservation from the 
observed particles 

5 

Put = -(Pit + ^2p jT ), (19) 
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while its longitudinal momentum can not be determined in this way due to the unknown boost of the partonic cm. 
system. Alternatively, it can be solved with twofold ambiguity through the on shell condition for the W-boson 

m 2 w = (p„ + pif '. (20) 

Furthermore one can remove the ambiguity through the reconstruction of another top quark. For each possibility we 
evaluate the invariant mass 

Mf lu = {pf+P,+ Pj ) 2 , (21) 

where j refers to the any one of the two left jets and pick up the solution which is closest to the top quark mass. 
With such a solution, one can reconstruct the 4-momentum of the neutrino and that of another top quark. 
In our following numerical calculations, we apply the basic acceptance cuts(referred to as cut I) 

Pit > 20 GeV, p jT > 20 GeV, $ T > 20 GeV, 
M<2.5, |t&|<2.5, AR jm >0A, 

\M jJv -m t \< 30 GeV, \M jbjcjd - m t \ < 30 GeV, \M jbjc - m w \ < 10 GeV. (22) 
To purify the signal, we further adopt the following cuts: 

• Cut II: \M jjbjc3d - M\ < 10% M or \M jjalu ~ M\ < 10% M. 

• Cut III: We demand the remaining jet that cannot be used to reconstruct top quarks to be b-jet. 

The ^-tagging efficiency is assumed to be 60% while the miss-tagging efficiency of a light jet as a b jet is taken as 
transverse momentum dependent (27j : 



Q 



1 

150' 
1 , Pt 



P t < 100 GeV, 

450 '25GeV " ^ 100 GeV < Pt < 250 GeV, (23) 

— , P T > 250GeV. 

50 

In Fig. [3J we display the distributions with respect to the invariant mass between the reconstructed top(antitop) 
and the remaining jet, i.e, 1/ 'a (da /dM t b + da/dM^) after cut I at LHC. The cross sections for the signal processes 
Q16p and ([17]) with tan/3 = 30 and different charged Higgs mass after each cuts at LHC 8 and 14 TeV are respectively 
listed in Table. Q] and Table. [TTJ The dominant SM background related to the signal is pp — > tij — > Z ± + 5 jets + j£ T 
process. We employ MadEvent[28j to simulate the background processes. The other SM background processes, eg, 
Wjjjjj, WWjjj and WZjjj, etc. are dramatically reduced by the acceptance cuts we adopted and therefore we 
neglected them here. Supposing the integral luminosity to be 20 at y/s = 8 TeV, one can notice that it is 

difficult for the charged Higgs associated with a top quark to be detected when its mass is above 500 GeV. While with 
300/fo -1 integral luminosity at 14 TeV, the tH~ production is easier to be observed. Detailed analysis shows that for 
pp — > tH~ — > ttb — > l + (or l~) + bbbjj + $t process at 14 TeV , the significance of signal to background can also be 
above three sigma for the charged Higgs mass M < 1 TeV. Therefore, in the following, we will focus on investigating 
the angular distributions for the processes ([TBf and (JTTJ) at y/s = 14 TeV with tan/3 = 30. 

From Eqs. ([7]) and ([5]). one can notice that top quark spin effect is related to the product of the coupling g a and <?&. 
Use the same method as in ref. [29[ , we find that this kind of top quark spin effects can be translated into the angular 
distributions of the charged leptons. Here corresponding to the process (|16l) and (|17p . we respectively introduce two 
kinds of angular distributions 

1 da 1 . , .a,. 1 da 1 . T 

'I ^=o 1 +^ B cosr, = [1 + AfbcosO*], 24 

a a cosy 2 a dcosu* 2 

where 

cose * = f±-?L, C0S r = PL_Pi. (25 ) 
|p*+IIPtl IpMIp*I 

Here p* + is the 3-momentum of charged lepton in the top quark rest frame is the 3-momentum of the top quark 
in tH~ cm. frame. While p ; *_ is the 3-momentum of charged lepton in the anti-top quark rest frame pj? is the 
3-momentum of the anti-top quark in the charged Higgs rest frame. Afb and Afb in eq.(|24p can be determined by 

_ a{cos9* > 0) - a(cos8* < 0) A - °( cos ®* > °) _ °(cos6* < 0) 
FB ~ a{cos9* > 0) + a(cos9* < 0) ' FB ~ a(cos9~* > 0) + a(cos9* < 0) ' ' ' 
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FIG. 3: The distributions 1/ 'a(da / 'dM t b + da / dMf b ) with respect to the invariant mass between the reconstructed top(antitop) 
and the remaining jet after cut I at LHC. 



These observables reflect the Htb interaction. In the following we will investigate the angular distributions for three 
different combinations of g a and gb 

• (SaSb) > 0, eg., g a = ±g w (tan/3m b + cot / 9mt)/(2v / 2mw), gb = ±3w(tan^m 6 - cot f3m t ) / (2\/2mw) ■ 

• (9a9b) = 0, eg., g a — 0, gb — gw(tan/3m& - cot /3mt)/(2v / 2mw) or g a = gw(ta.n(3rrib + cot/3m t )/(2v / 2mw), 
9b = 0. 

• (5aff&) < ; e g-) 9a = ±3w(tan/3m h + cot / 9m t )/(2v / 2m w ), gb = T#w(tan/?m b - cot /3r7i t )/(2v / 2m w ). 

The charged lepton angular distributions with respect to cos (9* and cos 8* before and after all cuts are respectively 
shown in Figs. [4] and [5] The related predictions for Aps and Aps are listed in table UTTl Due to the fact that the 
contribution from the s-channel(FigQJa)) decreases as the charged Higgs mass increases, before all the acceptance 
cuts, the cos6>* distribution and the related results for Aps, which are related to tH~ production also depends on 
M, while the cos 6* distribution and the related results for Afb, which are related to the charged Higgs decay do 
not depend on M. The cosO* — — \{cos0* = —1) region corresponds to leptons that are emitted into the hemisphere 
opposite to the (anti)top direction of flight in the tH~ cm. frame. These leptons are therefore less energetic on 
average and thus more strongly affected by the acceptance cuts than those in the remaining region [3(j. Therefore the 
presence of the acceptance cuts severely distort these distributions in the vicinity of cos6>* = — l(cos#* = — 1) region 
as shown in Figs. [4]and[5] Therefore for Aps and Aps after all acceptance cuts, we choose cos# ranges from —0.5 to 
0.5. It seems that after the acceptance cuts, the angular distribution with respect to cosO* (cos 6**) and Apb(Apb) is 
more helpful to investigate the Htb interactions for light (heavy) charged Higgs production associated with top quark 
at LHC. 



IV. SUMMARY 



The observation of charged Higgs would be an unambiguous signal for the existence of new physics beyond SM. 
Therefore it is important to study the related phenomena both at theory and experiments. In this paper, we study 
the tH~ associated production via pp — > tH~ — > tib I + bbbjj + process at LHC. It is found that with 300 
fb^ 1 integral luminosity at y/s = 14 TeV, the signal can be distinguished from the backgrounds for the charged 
Higgs mass up to ITeV or even larger. If the tH~ production is observed at LHC, one of the key questions is to 
identify the Htb interaction. For this aim, we investigate the angular distributions of the charged leptons and the 
related forward-backward asymmetry induced by top quark spin. It is found that these distributions and observables 
are sensitive to the product of g a and gb so that they can be used to identify the Htb interaction. Though further 
studies are still necessary both at theory and experiments, the Htb interaction can be studied by the help of the 
charged lepton angular distribution and the related forward-backward asymmetry in the charged Higgs and top quark 
associated production at LHC. 
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FIG. 4: The angle distribution of the charged lepton for M = 300, 800 GeV with nocut and all cuts at y/s = 14 TeV respectively 
for the process of pp — > tH~ — > l + + 5jets + |?T.The solid line represents (g a gt) > 0. The dashed line represents {g a gb) = 0. 
The dotted line represents (g a gb) < 0. 



Signal 


a(pp -> tH~ -> ttb -»• I* + 5jets + fi T ) (fb) 


M(TeV) 


0.3 


0.5 


0.8 


1.0 


No cuts 


45.18 


8.62 


1.02 


0.30 


Cut I 


11.72 


2.20 


0.25 


0.07 


+Cut II 


9.59 


1.73 


0.20 


0.05 


+Cut III 


5.76 


1.04 


0.12 


0.03 


Background 


a(pp -> ttj -> « ± + 5jets + fi T ) (fb) 


Cuts I+II+III 


10.25 


3.85 


0.97 


0.46 


S/B 


0.56 


0.27 


0.12 


0.07 


s/Vb 


8.05 


2.37 


0.54 


0.20 



TABLE I: The cross section of the signal process pp — > tH — > + 5jets + ftr and the background process of pp — > ttj — ¥ 
I + 5jets + pr at ^/s = 8 TeV after each cut. 
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cos9* cos8* 



FIG. 5: The angle distribution of charged lepton for M — 300, 800 GeV with nocut and all cuts at y/s — 14 TeV respectively 
for the process of pp — > tH~ — >• l~ + 5jets + |?T-The solid line represents (g a gb) > 0. The dashed line represents {g a gb) = 0. 
The dotted line represents {g a gb) < 0. 



Signal 


a(pp -»■ tH~ -> ttb -»• + 5jets + J£ T ) (fb) 


M(TeV) 


0.3 


0.5 


0.8 


1.0 


No cuts 


262.82 


65.96 


11.56 


4.28 


Cut I 


65.79 


16.41 


2.75 


0.95 


+Cut II 


54.12 


13.00 


2.20 


0.77 


+Cut III 


32.47 


7.80 


1.32 


0.46 


Background 


a(pp -> ttj -tl ± + 5jets + fi T ) (fb) 


Cuts I+II+III 


43.54 


18.97 


5.95 


3.22 


S/B 


0.75 


0.41 


0.22 


0.14 


s/Vb 


85.23 


31.02 


9.37 


4.44 



TABLE II: The cross section of the signal process pp — > tH — > + 5jets + fir and the background process of pp — > ttj — > 
I* + 5jets + fir at y/s = 14 TeV after each cut. 
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Afb 


Afb 


without cuts 


M(TeV) 


0.3 


0.5 


0.8 


1.0 


0.3 


0.5 


0.8 


1.0 


(g a g b ) > 


0.124 


0.075 


0.023 


-0.003 


-0.173 


-0.173 


-0.172 


-0.173 


(ga,9b) = o 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


(gagb) < o 


-0.125 


-0.076 


-0.024 


0.001 


0.172 


0.173 


0.174 


0.173 


with cuts 


(gagb) > 


0.002 


-0.015 


-0.031 


-0.041 


-0.014 


-0.050 


-0.054 


-0.061 


(g a gb) = o 


-0.028 


-0.030 


-0.033 


-0.041 


-0.022 


0.007 


0.006 


-0.006 


(gagb) < o 


-0.056 


-0.048 


-0.037 


-0.040 


-0.033 


0.081 


0.077 


0.065 



TABLE III: The forward-backward asymmetry Afb(Afb) for pp -> tH -> l + (I ) + 5jets + fir at LHC yfs = 14 TeV before 
and after all cuts. 
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